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(57)Abstnsot: 

PURPOSE: To provide an image recognition algorithm 
constructing device whieh Is capable of easily 
constructing an image recognition algorithm, 
OONSTITyTlON: A menu ciisplay Is performed for an 
image processing sub-routine on a monitor 32 by a menu 
device. When an operator selects a desired image 
processing syb^routin^, the image processing is 
temporarily performed and the result Is displayed on the 
monitor 32. When the operator is not satisfied with the 
result, he cancels the selection. When he is satisfied 
with the result, he performs a registration. The 
registration is performed by writing the image processing 
sub "routine in an image processing mem is 
used as a table. By referring to this image processing 
memory S4 and calling the registered image processing 
sub—routine from an image processing library 39 by an 
operation control task 48, an image recognition program 
executing a desired image processing is realized. 
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* NOTICES * 

JFO snd INpIT are not resigns i Ms for m$ 
4mmm caused by the use of this trm&lMim* 

1: /This document has bean translated by computer. So the translation may not reflect the original 
precise iy, 

shows the word which can not be translated. 
Sin the draws ngs, any words are not translated. 



[Claim(s33 

[Claim 1]In an image recognition program construction device which builds an Image recognition 
program which recognizes a picture by performing two or more Image Processing: Division, With a 
memory measure which memorized two or more Image Processing Division subroutines which 
perform predetermined Image Processing Division, a displaying" means which carries out the 
menu indication of said Image Processing Division subroutine memorized by said memory 
measure, and an operator's directions. An image recognition program construction device 
including a selecting means which chooses a desired subroutine from said menu indication, and a 
construction means which builds an image recognition program which calls a subroutine with said 
selected selecting means, and includes execution of this called subroutine. 

[Claim 2jln the image recognition program construction device according to e^aim 1 r further said 
selecting means. An image recognition program construction device, wherein said image 
recognition program construction means includes a preparing means which creates a main 
program which carries out sequential execution of the Image Processing Division subroutine 
registered into said table including a table means by which said selected Image Processing 
Division subroutine is registered. 

[Claim 3]In the image recognition program construction device according: to claim 1 or 2, said 
selecting means, An Image Processing Division result display means to perform Image Processing 
Division corresponding by performing the selected Image Processing Division subroutine, and to 
display the prG&QSsmg result, An image recognition program construction device including a 
selection release means of which selection of said Image Processing Division subroutine as 
which a processing result was displayed is canceled with an operator's directions, 
[Claim 4 Jin an image recognition program construction method of building an image recognition 
program which recognizes a picture by performing two or more Image Processing Division, With a 
preliminary process for which two or more image Processing Division subroutines which perform 
predetermined Image Processing Division are prepared, a display process of carrying out the 
menu indication of said said prepared Image Processing Division subroutine, and an operator's 
directions. An image recognition program construction method including a selection process 
which chooses a destr&d subroutine from said menu indication, and a construction process which 
builds an image recognition program which calls a subroutine with said selected selection 
process, and includes execution of this called subroutine. 

[Claim 5]In an image recognition program construction method according to claim 4< further said 
selection process, A table registration process of registering said selected Image Processing 
Division subroutine into a table, and said image recognition program construction process, An 
image recognition program construction method including a creation process of creating a main 
program which carries out sequential execution of the Image Processing Division subroutine 
registered into said table. 

[Claim §j!n an image recognition program construction method according to claim 4 or § v said 
selection process. The Image Processing Division result display process of performing Image 
Processing Division corresponding by performing the selected Image Processing Division 
subroutine, and displaying the processing result. An image recognition program construction 



http;//w^ 20 10/06/08 



2/2 



method including; a selection release process tliat an operator's directions oarseei selection of 
said Image Processing Division -sob-routine as which a processmig result was displayed. 

pTmn st&ilon d one J 
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[Detailed Description of the Invention] 
[0001] 

[industrial j^|>^eatio;n3THI^ Invention relates to the device which recognizes the subject Cit is 
hereafter called a "work"') which is a recognition object. It Is related with the building device and 
method of an image raGopiition program of an optica! image recognition device of recognizing a 
work, by performing predetermined Image Processing Division to the pi cture of the work obtained 
by picto nztng a work especially, 
[0002] 

[Description of the Prior Art]0onventionai1y x m productiOR facilitjes, such as a car, the optica! 
work recognition device Is used for the check of parts haying: been attached normally, or the 
inspection. This optical work recognition device applies the art of Image Processing Division, and 
recognizes the work. 

[00 03 Jin a production facility, since production is presented with usually various parts, the 
above-mentioned work reoognltsdn device also needs to recognise such a variety of works. Thus, 
in order to reoognke the work of two or more kinds, inventfenHn^this ^application persons had 
adopted the following means, 

[OO04j(l) Install two or more image recogriition devices incorporating an image recognition 
algorithm for exclusive use for every work, and choose a suitable device as It according to the 
target work. 

[00051(2) Build said two or more Image recognition algorithms Into a highly eMc lent image 
processing device, and choose an algorithm as it according to the target work, 
[0006] In many conventional production facilities, what is called a production instruotion device 
(assembly line control is mtroduced, and It Is always directed on each line what kind of 

part Hows into each factory line (production Instruction). In the above (1} which mventionHn'~ 
this—application persons had adopted, and the device of the suitable image recognition device 
was chosen according to this production Instruction. 

[000 7] So to speak in the above CD; hardware (image recognition device) was chosen according 
to the work. To it, I hear that the software used inside the image recogmtion device of a piece is 
chosen from two or more candidates, and (2) has it. Although, as for the Image Processing 
Division speed, the direction where hardware was generally chosen becomes quick, since 
hardware quantity increases : | there is a fault used as an expensive thing. Therefore, In the stage 
in earfy stages of a start of production, it is common to adopt the device of C t) by seleetio n of 
hardware with expansion of a production scale using the device of C2) by selection of software, 
j^0O8]Therefbre, it wit! be necessary to transpose Image Processing Division by software to the 
picture treatment by hardware, In order to carry out such replacement, based on the design of 
image processing software^ the method of designing the hm-dwBr^ for Image Processing Pi vision 
Is proposed variously. For example, in di^MSH 2B4?6 ? A, the method of designing hardware is 
indicate d from software based on knowledge dat&, 

[0009]Thus, it is possible by changing the algorithm of Image Processing Division according to 
each work to conduct the surveillance, inspection, etc. of two or more works. 

[0010]As stated above, the conventional image recognition device supported two or more works 
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by changing Hardware or software, 
[0011] 

[Prohl em(s> to be Solved by the feven^ionlTha conventional image recognition device was 

constituted as mentioned above, Therefore, there were trie following problems. 

[OG'1 23(1) While according to the technique provided with the above— r^entioned hardware for 

every work hardware quantity becomes large and cost becomes large, the area of Installation 

area afso has the probl em of baeomlng large. To change an image recognition algorithm, It Is 

necessary to reinstall the exclusive program which exchanged the whole hardware of each Image 

recognition device, or was designed for every work in each image recognition device. Therefore, 

there were a routing counter for change and a problem that cost will become large. 

[DDI 33ln development of an algorithm, since the special engineer had to perform confirmation 

work of operation of an algorithm by trial and error, efficient development work was not able to 

be performed. 

[001' 4] (.2) It had two or more software, and a coo rding to the teohnlque of changing software 
according to the target work/ loading of so there was a problem that 

execution time will become late. 

[00 I S] Since it was the check of operation of the software which needed to perform development 
of software through the work of compile etc, from coding of software, and was competed, 
confirmation work of operation of the software had to be perforrned by trial and error like the 
above CI ), 

[001 6]!n order to correspond to a new work, also when new software was buife, it was not able to 
change promptly by the check of the operation taking time, 

[00 1 7] And since the know how was required for coding of software f and compi le> after the image 
recognition device was introduced into the spot, there was a problem that it was difficult for an 
on-site preservation person to maiptain the device, 

[OOl BjThis invention is made in view of an aforementioned problem, and the purpose is to 
provide the devi ce and method of building for an image recognition algorithm easily. 
[0019] 

[Means for Solving the Problerrflln order to attain the above purposes, this invention, In an Image 
recognition program construction device which builds an image recognition program which 
recognizes a picture by performing two or more Image Pro c ess ing Division, V^ith a memory 
measure which memorized two or more Image Processing Division subroutines which perform 
predetermined Image Processing Division, a displaying means which carries out the menu 
indication of said Image i^rocessing Division subroutine memorized by said memory measure, and 
an operators directions. A subroutine with a selecting means which chooses a desired 
subroutine from said menu indication, and said selected selecting means is called, It is an image 
recognition program construction device including a construction means which builds an image 
recognition program i hoi uding execution of this called subroutine. 

|00&0]To achieve the above objects this invention, In an above Image recognition program 
construction device, further said selecting means, It is art image recognition progr&m 
construction device including a preparing means which creates a main program which carries out 
sequential execution of the Image Processing Division subroutine by which said image 
recognition program construction means was registered into said table including a table means 
by which said selected Image Processing Division subroutine is registered. 

[0021 ]To achieve the above objects this invention. In an Image recognition program construction 
device of two above— mentioned inventions, said selecting means, M Image Processing Division 
result display means to perform Image Processing Division corresponding by performing the 
selected Image Processing Division subroutine, and to display the processing result, It is an 
image recognition pramam construction device including a selection release means of which 
selection of said Image Processing Division subroutine as which a processing result was 
displayed is canceled with an operator^ directions^ 

[G022]To achieve the above objects this invention In an image recognition program construction 
method of building an image recognition program which recognizes a pictyre by performing two or 
more Image Processing DIvisionrTOth a preilmlnary process for which two or more Image 
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Processing Division subroutines which perform predetermined Image Processing Division are 
pr&pared, a display process of carrying out the menu indication of said said prepared Image 
Processing Division subroutine, and an operators directions. A subroutine with a selection 
process which chooses a desired subroutine from said menu indication, and said selected 
selection process is called. It is the image recognition program construction method including a 
construction process which builds an image recognition program including execution of this 
called subroutine. 

L0023]To achieve the above objects this invention, In an above— mentioned image recognition 
program construction method, further said selection process, A table registration process of 
registering said selected Image Processing Division subroutine into a table, and said image 
recognition program construction process, It is the image recognition program construction 
method including a creation process of creating a main program which carries out sequential 
execution of the Image Processing Division subroutine registered into said table, 
[0024]To achieve the above objects this invention, In two above— mentioned image recognition 
program construction methods, said selection process, The Ima^e Processing Division result 
display process of performing Image Processing Division corresponding by performing the 
selected Image Processing Division subroutine, and displaying the processing result. It is the 
image recognition program construction method including a selection release process that an 
operator's directions cancel selection of said Image Processing Division subroutine as which a 
processing result was displayed. 
[0025] 

[FunctionjThe selecting means in this invention chooses a predetermined subroutine with an 
operator's directions. And an image recognition program construction means builds the image 
recognition program which calls the selected subroutine. Therefore, even if it does not have 
know hows, such as coding of a program, and compile, construction of an image recognition 
program is possible. Since the table, means in this invention creates the main program which 
carries out sequential execution of the subroutine by which the Image Processing Division 
subroutine was registered and the preparing means Was registered into this table means, it can 
build easily the image recognition program which performs each subroutine. 

[082 6 j The Image Processing Division result display means in this invention displays the executed 
result of the Image Processing Division subroutine with the selected selecting means. And if an 
operator is not satisfied with the result, he can cancel selection by a selection release means. 
Therefore, construction of an Image recognition program is possible with slight accuracy in the 
result of Image Processing Division. 

[0Q27]The selection process in this Invention chooses a predetermined subroutine with an 
operator's directions. And an image recognition program construction process builds the image 
recognition program which calls the selected subroutine. Therefore, even if it does not have 
know hows, such as coding of a program, and compile, construction of an image recognition 
program is possible. In [ the table registration process in this invention registers the Image 
Processing Division subroutine into a table, and ] a creation process, Since the main program 
which carries out sequential execution of the subroutine registered Into this table is created, the 
image recognition program which performs each subroutine can be built easily. 
[GQ28]The Image Processing Division result display process in this invention displays the 
executed result of the Image Processing Division subroutine selected in the selection process. 
And selection is canceled by the selection release process if an operator is not satisfied with the 
result. Therefore, construction of an image recognition program is possible with slight accuracy 
in the result of Image Processing Division. 
[0029] 

[Example! Hereafter, suitable working example of this invention is described based on Drawings. 
[0030jThe entire configuration figure of the wrong/missing part recognition system of the parts 
(it is hereafter called a "work") using the image recognition device 10 of this example is shown in 
drawing I . This system contains the cameras 12a, 12b, 12c, and 12d which photo a work* and the 
cameras 1 2a T 1 2b, and 12c and the sighting systems 14a, 1 4b r 14c, and 14d formed every 1 2d as 
shown in drawing 1. The video signals VIN1-VIN4 which each camera outputted, and the 
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synchronized signals SYN1~SYN4 are supplied to the image recognition device 10 via the o&misrB 
switcher 16. This camera switcher 18 contains the synchronizing pulse distributors unit I S which 
supples the synchronized signal of any one ****** for the above-mentioned synchronized 
signals 3YN1—N to the image recognition device 10, and the video-signal switcher 20 which 
supplies the video signal of any one ****** for the above-mentioned video signals VIN1 ~N to 
the image recognition device 10. 

[003 1]In tNs example, characteristic composition is the image recognition device 10, and other 
composition of it is the same as the conventional composition. This image recognition device 10 
inputs the picture photo ed with the cameras 12a, 12b, 12c r and 12d, by performing 
predetermined Image Processing Division, is the point of recognizing a work and has the same 
work as the conventional image recognition device. However, the algorithm which performs this 
recognition, i.e., an image recognition algorithm, can change Image Processing; Division easily 
included in that image recognition algorithm by an operator's operation so that it may mention 
later. Therefore, according to this example, even if It does not repeat the coding compile by an 
expert, it is possible to deal with change of the work which is the target of recognition easily. 
[GQ32] This system contains ALG24 which supplies production instruction information in the 
various equipment which constitutes a factory line with the wrong/missing part recognition host 
22 who judges that the wrong/missing part of the work arose, when a work has not been 
recognized, 

[0033] The image recognition device 10 adjusts an automatic diaphragm of the cameras 12a, 12b, 
12c, and 12d via automatic diaphragm Interface Division 28, and adjusts lighting systems [ 14a, 
14b, 14c t and 1 4d ] illumination via illumination control Interface Division 30. And the monitor 32 
is connected to the image recognition device 10 in order to control and supervise operation of 
the image recognition device 10. On this monitor 32, it is possible to choose and register each 
Image Processing Division which the menu which is the characteristic composition of this 
invention Is displayed, and constitutes an image recognition algorithm with the directions from an 
operator so that it may mention later, 

[003-43 On the other hand* the wrong/missing part recognition host 22 controls the camera 
switcher 16, and changes the video signal and synchronized signal which are supplied to the 
image recognition device 10. 

[0035] In this example, explanation of the image recognition device 10 which is characteristic 
composition, and explanation about the method of pieturlzihg a work are given by following 1., 
and explanation by the whole operation of the wrong/missing part recognition system of this 
example is given by 2, 

[003-8 j 1 . Image recognition device and method 1,1 of picturizing work The image recognition 
device 10 in image recognition device this example comprises a processor and software which 
this processor performs. The composition of the software of the image recognition device 10 is 
shown in drawing 2, RB232C driver 40 and the Df/DO driver 42 are hardwares which output and 
input a signal among a figure, and the data module 44 Is the memory storage which memorized 
data. All "tasks'' other than these devices is software, 

[0037]The image recognition device 10 in this example constitutes the computer which realizes 
what is called real-time multitasking. 

Two or more "tasks" can he performed simultaneously. 

However, this invention is realizable also by computer by which real-time multitasking is not 
realized. 

[0038] Refer to the data module 44 for all the tasks shown in drawing 2. That is, in this example, 
since operation of a task is controlled by setting various values to the data module 44, supple 
processing is realized. For example, it is possible by setting the number of Image Processing 
Division as the data module 44 to register Image Processing Division performed on an image 
recognition algorithm. This registration can be changed when an operator chooses from the menu 
displayed on the monitor 32, When a new image recognition program compatible with a new work 
is required, it is also possible to build the new image recognition program which performs desired 
Image Processing Division by selection. 

[0O39}And if Image Processing Division with an operator is chosen from the menu on the monitor 
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32 t the Image Processing Division will be earned out temporarily and the result of the Image 
Processing Division will be displayed en the monitor 32. Therefore, since the operator can check 
the effect (result) of selected Image Processing Division promptly on the monitor 32> the trlah- 
anci-errar adjustment by an expert is not needed like before. If the result of this check is 
satisfying, that Image Processing Division will be registered. Registration is performed by setting 
the number of the Image Processing Division as the above-mentioned data module. It is also 
possible to cancel registration if the result of a check is unsatisfying. In this example, it is 
possible to choose Image Processing Division interactively on the menu screen of the monitor 32 
in this way> 

[0040]Thus, by registering, it is possible to include desired Image Processing Division m an image 
recognition algorithm. 

[004t]DeIetfon of Image Processing Division included in the algorithm from before is also 
performed by canceling registration with the directions from a menu, as mentioned above. 
Change of an image recognition algorithm or construction of a completely new image recognition 
algorithm is easily feasible by deleting predetermined Image Processing Division and registering 
Image Processing Division of a new request into an algorithm. 

[OG423it is at this point that it is characteristic in this example. Namely, with change of a work, 
conventionally, building an image recognition algorithm, combining various Image Processing 
Division appropriately was not completed, when it was not a fixed expert, but. In this example, 
desired Image Processing Division is only chosen from the menu, and the image recognition 
algorithm with which the Image Processing Division was incorporated is built automatically. 
Therefore, construction of an algorithm is easily possible also for an inexperienced personnel to 
coding, compile, etc. 

[0®48jThus, the example in which an image recognition algorithm is built is explained using 
drawing 8, The partial iinebiook diagram of the wrohg/mlssing part recognition system centering 
on the image recognition device 10 is shown in drawing 3 y The display example of the menu in 
case selection of a binary-ized method is performed as one of the Image Processing Division is 
shown in the portion surrounded with the dashed line to which ^selection of a bihary(example)™ 
ized method" and a title are given among drs wing 3. 

[OQ443 First, the following top menus are displayed on the screen of the monitor 32. 
[0fJ45ja good— ized binaryHzed binary format image good —equality ghost object extraction 
characteristic quantity Measurement Division judging and collation of a treatment area limited 
shade image — such seven items are shown in the top menu. The item of this top menu is 
shown In the I eft— hand side of the portion of the dashed line shown by ''selection of a binary 
(exampfe)-ized method" of drawing 3, An operator chooses the Item of "binary— izlng" from a top 
me nu to choose Image Processing Dlvi stoh of binary "izing, for example. 

[0048] Then, the menu of a medium is displayed on the screen of the monitor 32. There, each 
class at. the time of roughly dividing processing of bsri-aryH!zi ng" Into-: two kinds is displayed. In this 
example, the item displayed as these classes is as foliows. 

The operator chose '"automatic binary-ization" now [ fixed hlnaryHzed automatic bfhiary^-jzed ] 
corresponding to the work. Then, the lower ia^er menu jn which the hinarization processing 
classified into the class of the formation of an automatic binary Is shown as ah item is shown on 
the monitor 3£L Each item included in the menu of imagination is as fbllows, 

[0047] MAX and a M1M binary — inHzing feas^^ constant 
area binary-ized histogram bin a ryH zed floating binary "ized this example, only the thing of two 
kinds of concentration of a work and its background is displayed on the screen photoed by the 
cameras 1 2a- 1 2d, for example. Since the operator knows this beforehand, it expects that the 
luminosity on the photoed screen Is ^ in this case, an 

operator thinks that he will classify the luminanqe value by a histogram* and choose s upper 
"histogram binary- ization." "Histogram bina^Hzatson'' is the method of building the histogram of 
the luminance value on a screen and carrying out binaryHzation based on the tendency of a 
histogram. 

[0048 jlf desired Image Processing Division Is chosen as mentioned above /the result of having 
carried out the Image Processing Division immediately Will be displayed on the monitor 32. 
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Therefore, an operator will register the Image Processing Division task of this "formation of a 
histogram binary" into an image recognition algorithm as it is, if satisfied with the result of that 
Image Processing Division, When not satisfied with a result, selection from a top menu will be 
repeated again. 

[0049jSinoe an interactive response with an operator can be repeated in this way and Image 
Processing Division can be made to choose it as an operator, the image recognition device 10 In 
this example can be easily performed, even if construction of the image recognition program 
which performs the selected Image Processing Division task is not an expert. 

[00 SO] According to this example as mentioned above, the thing for which it only chooses from a 
menu and desired Image Processing Division is included in an algorithm (registration) and to do is 
possible. Therefore, construction of the image recognition algorithm with which the expert was 
performing coding compile from the beginning whenever change arose to the work conventionally 
can carry out very easily. 

[0051]Thus f the example of the image recognition algorithm built by selection is shown in the 
portion surrounded with the "creation (example) algorithm" and the dashed tine to which the title 
was given among drawing. 3. The image recognition algorithm shown here is an image recognition 
algorithm in case a work is a ''resin label for example. And "the resin label (algorithm No."!)" 
and the title are attached and shown in the left-hand side of the portion on which this Image 
recognition algorithm was shown with the dashed line, the image recognition algorithm of this 
"resin label" — "image taking" and a "window set" — it is an algorithm which Image Processing 
Division is performed in ... and order, and execution ends by Image Processing Division of "left 
end object extraction"', "characteristic quantity Measurement Division ', and "a judgment/' 
[0O52]The image recognition device 10 in this example can memorize two or more image 
recognition algorithms. That is, it is possible to store two or more algorithms in the above- 
mentioned data module 44, 

[0053] And the image recognition algorithm corresponding to a work is used in the image 
recognition device 10 by the directions information from the wrong/missing part recognition host 
22 so that it may mention later, 

[0054] Although the candidate of Image Processing Division which is the target of selection with 
a menu makes the Image Processing Division library 39 memorize beforehand, the special expert 
creates beforehand the program of the Image Processing Division task itself which performs this 
Image Processing Division in consideration of various situations (coding and compile). 
[QQSSjWhen the work which should foe recognized was changed and not only existing Image 
Processing Division but completely new Image Processing Division Is needed, a special expert 
creates only the Image Processing Division task, and should just register with the Image 
Processing Division library 39. By choosing this registered new Image Processing Division from 
the menu in the monitor 32, the new image processing algorithm for reeognizmg said work is 
built. Therefore, when there was change to a work, the whole image recognition algorithm needed 
to be rewritten conventionally, but since an expert should create only the portion of the required 
Image Processing Division task according to this example, it has the effect that construction of 
an image recognition algorithm can carry out very easily and promptly, 

[OGSOjThe image recognition device 10 m this example can build an image recognition algorithm 
easily in this way. In order to understand easily, the partial Hnebioek diagram of only the portion 
which builds this algorithm is shown in drawing 4. 

[0057] Each Image Processing Division task is memorized to the Image Processing Division library 
39 as shown in drawing 4, The monitor 32 contains the menu device 33, 
By this menu device* a menu is displayed on the indicator of a monitor. 

An operator chooses the predetermined item in a menu, for example with pointing devices, such 
as a mouse. Then, this menu device 33 registers the selected item into the image processing 
memory 84. The image processing: memory 84 is a predetermined field inside the data module 44, 
The Image processing memory 84 is making table structure. 
It is referred by the operation management task 48, 

The operation management task 48 carries out sequential execution of each Image Processing 
Division registered there by referring to the image processing memory 84 which is a table, Thus, 
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this invention is constituted within the image recognition device 10. 

[0058 j Operation of this whole image recognition device I D is explained using drawmg. 2 and 
drawing 3. The RS232C receiving task 46 shown in drawing 2. receives directions Information, 
including a number of an image recognition algorithm, binary level data, etc. which ware sent out 
from the wrong/missing part recognition host 22, and the received data is registered into the 
data module 44. When it is detected that said data was registered into the data module 44, the 
operation management task 48 shown In drawing 2 starts the initialization task 50 and the 
control data set task 52 f and performs re—memory allocation of the above-mentioned received 
data. In this example, re-memory allocation means the work of setting each parameter, such as 
binary level data, to the table for each Image Processing Division tasks based on received data. 
[0059] Next, the DJ/QO transmission task 54 outputs an illuminance value and a diaphragm value 
to illumination control Interface Division 30 and automatic diaphragm Interface Division 28. 
Illumination control Interface Division 30 changes into voltage information the illuminance value 
sent out by digital value by D/A conversion, and the optimal illuminance value for these is set up 
by supplying this voltage information to the lighting systems 14a~ !4d These automatic 
diaphragm values are adjusted by automatic diaphragm Interface Division's 28 changing into 
voltage snformation the diaphragm value sent out by digital value by D/A conversion, and 
supplying this voltage information to the cameras ! 2a~~12d. Next, when the DI/ DO receiving task 
56 receives the recognition start signal sent out from the cameras !'2a.-1 2d, this DI/OO 
receiving task 58 sets a recognition start signal to the data module 44. The operation 
management task 48 will start the image taking task 58, the Image Processing Division task 80, 
the judgment task 62, etc., if it detects that the recognition start signal was set to the data 
module 44. The image taking task 58 and Image Processing Division task 80 grade set each 
measuring result to the data module 44. And when this measuring result is set to the data 
module 44, the operation management task 48 starts the judgment task 62, and makes a 
wrong/missing part judge- The judgment task 62 sets the decision result about whether there is 
any wrong/mis sing part to the data module 44 with reference to the data module 44. 
[GOSGjThe operation management task 48 is supervising that each task and Image Processing 
Division are completed by referring to the data m the data module 44. And the operation 
management task 48 transmits a decision result to the wrong/missing part recognition host 22 
by starting transmit data set task 84, RS232G transmission task 86, and Dl/DO transmission 
task 54 and others, after all the tasks and Image Processing Division are completed, 
[OOO tlSince it is possible to make one image processing device equipped with two or more Image 
recognition algorithms and the image recognition algorithm corresponding to the work which is an 
object of recognition can be chosen by such operation, the high recognition rate of a work Is 
expectable. 

[0062jSo to speak in this example, "binaryHzation of each task", etc. is a unit of Image 
Processing Division. And since each task is managed by the operation management task 48 via 
the data module 44 as mentioned above, it can miniaturize each task. As a result, even if it is 
small processing units, such as a personal computer, it is possible to station permanently all the 
tasks including the operation management task 48 on the memory. Therefore, useless time,, such 
as doing loading of a program again for every processing, does not arise. 

[0063] The flow of detailed operation of this image recognition device 10 is explained based on 
draMng S. The flow of each processing is shown by the dashed fine in drawing . 5, 
[G084]!n processing of the dashed line first shown by in drawing the screen number of the 
work proceeding number to the work proceeding number of the image recognition work to do. the 
processing algorithm number of the work proceeding number, and the characteristic quantity 
algorithm number of a work proceeding number are stored in the schedule management memory 
80 now. A screen number is a number which specifies what is called a window in the screen of a 
piece. This schedule management memory 80 is some data modules 44, and the turn that Image 
Processing Division is performed is stored, 

[00853 The screen number corresponding to the work proceeding number from the wrong/missing 
part recognition host 22 in these screen numbers, etc. are sent out to the image recognition 
device 10. The wrong/missing part recognition host 22 searches for the above-mentioned screen 
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number etc. based on the production instruction information sent out from ALC24, and sends out 
to the image recognition device 10 so that it may mention later, 

[OG80]In processing of the dashed, line shown by ** in drawing* . S, a screen (window) is drawn on 
the screen of the monitor 32 by the screen coordinate in said screen number 

[006 7] In- processing of the dashed line shown by in drawing § v Image Processing Division only 
the number of the use table currently used there was indicated to be with the table number in 
order of the schedule is performed with reference to the algorithm management memory 82 of an 
image processing algorithm number. A use table is a table which stored the parameter etc- which 
are used in each Image Processing Division hare. The algorithm management memories 82 are 
some data modules 44, and are memories the table number of the table to be used is Indicated 
to be in the turn that Image Processing Division is performed, 

[0068] And the Image Processing Division code corresponding to the table number is obtained by 
referring to the image processing memory 84 of the table number. When the Image Processing 
Division code is not set, It is judged that the Image Processing Division is unregistered- !n this 
Image Processing Division code. Image Processing Division is specified and Image Processing 
Division is performed based on the p^r^tnet^r stored following on the Image Processing Division 
code. The entry (effective address) of the actual Image Processing- Division task corresponding 
to. the Image Processing: Division code is obtained by searching the image Processing Division 
code table 8.6. Thus, Image Processing Division shown with the table number is performed in 
order of a schedule. It cannot be overemphasized that the number of this Image Processing 
Division Is equal to the number of a use table. 

[OO60]:In processing of the dashed line shown by m drawing only the number of 
Measurement Division screens performs characteristic quantity Measurement Division 
processing during a schedule with reference to the algorithm m&nag&m&nt memory of a 
characteristic quantity algorithm number. Here, especially a characteristic quantity algorithm 
means the image recognition algorithm which measures characteristic quantity. 
[0070] The image recognition program in this invention contains not only the image recognition 
algorithm mentioned above in this example but this characteristic quantity algorithm. In a 
characteristic quantity algorithm, a work is recognized by measuring characteristic quantity. 
[0071] This characteristic quantity algorithm is also constituted so that two or more 
predetermined Image Processing Division tasks may be called, and predetermined Image 
Processing Division is performed. The algorithm management memory corresponding to a 
characteristic quantity algorithm is called the Measurement Division characteristic quantity 
management memory 88 especially in this example, 

[0072] First, processing is started from the Measurement Division screen number "V t and only 
the number of algorithm tables (number of the table used with an algorithm) performs Image 
Processing Division shown in the table number, and extracts a work {recognition), it performs 
specifying Image Processing Division corresponding to it like the explanation of** mentioned 
above from a table number. 

[0073]ln execution of a characteristic quantity algorithm, the characteristic quantity shown in 
the characteristic quantity code memorized by the Measurement Division characteristic quantity 
management memory 88 is measured. Only the number of times with Measurement Division of 
character] stic quantity equal to the number in which this characteristic quantity code is stored is 
performed. Specifying a characters stic quantity command (Image Processing Division) is 
performed, by searching the characteristic quantity code table 90 from each characteristic 
quantity code. 

[0074] In- .processing of the dashed line shown by in drawing 5, the measured characteristic 
quantity is the same turn as the order (characteristic quantity numerical order) of a schedule 
currently recorded on the Measurement Division characteristic quantity management memory 88, 
and is set to the Measurement Division data memory 92, This Measurement Division data 
memory 92 as well as other memories is some data modules 44, 
[0075jiThus, in this example, data is exchanged via the data module 44. 

[0078] t. 2 Explanation of the method of pictunzing a work is also in eluded in pieturizing method 
drawing; 3 of the work. For every environment where each work and a work are placed, the 
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Lighting Sub-Division illumination, a binary level, and the optimal image pick-up conditions of a 
diaphragm are tested beforehand, and are checked. Thus, the data of the Lighting Sub-Division 
illumination etc. which were obtained Is memorized in the database for every work. This database 
is built on the hard disk in the wrong/missing part recognition host 22. 

[007?] The wrong/missing part recognition host 22 by searching said database from the work 
information included In the production instruction information sent out from ALC24, and the 
attachment ring boundary information on this work (a color, spec, mold). The optimal image pick- 
up conditions, such as illumination corresponding to this work, a diaphragm, and a binary level, 
can be searched for; These optimai image pick-up conditions are sent out to the image 
recognition device 10, as mentioned above. And i Rumination and a diaphragm value are changed 
into a pressure value from the image recognition device 10 by D/A conversion with the 
illumination control interface 30 or the automatic diaphragm interface 20. Thus, a diaphragm and 
illumination are controlled by the changed pressure value, 

[0078] Thus, the image pick-up conditions corresponding to each work are set up. Since the 
diaphragm was adjusted in the conventional automatic diaphragm so that the luminosity of a 
screen might become fixed, there was a possibility of having changed a diaphragm by disturbance 
light and changing the image pick -up conditions over the work which Is a recognition object, but. 
Since image pick— up conditions are fixed with a work according to this example (an operator is 
able to change), there is no possibility of changing by disturbance light. Since image pick-up 
conditions can be beforehand set up before image recognition based on production instruction 
information according to this example, processing"-smage-"recognition time does not become long 
for waiting time until a diaphragm is stabilized. Since resolution falls when extracting too much, 
but image pick—up conditions would not be set up only by diaphragm but illumination wilt also be 
doubled and controlled by this example if image pick-up conditions are controlled only by 
diaphragm, resolution is able to prBVBnt from failing. 

[007912, As beyond explanation of operation of a wrong/missing part recognition system stated, 
two or more algorithms corresponding to each work, and each work and the image pick-up 
conditions for every attachment ring boundary of the are memorized by the wrong/missing part 
recognition host 22 as a database. Hereafter, explanation of operation of a wrong/missing part 
recognition, system is explained based on the Bow chart shown in drawing 6. 

[OOSOllf production instruction information (a color, a mold, etc.) is sent out (step ST5-1), based 
on production instruction information, the wrong/missing part recognition host 22 will search said 
database,, and will acquire directions information (an algorithm number, illumination, a diaphragm, 
a binary lave!) from ALC. And the wrong/mis sing part recognition host 22 sends out this 
directions information to the image recognition device 10. 

fOOBllln the image recognition device 10, in advance of image recognition, as mentioned above, 
setting out of image pick—up conditions is performed beforehand (step ST5-2), The 
wrong/missing part recognition host 22 controls the camera switcher 18, and makes the video 
signals VfNI -VIISI4 from the desired cameras 12a-T2d and the synchronized signals SYN1-SYN4 
input into the image recognition device 10 (step ST5-3X If it is detected that the work which is a 
recognition object reached the specified position after image pick-up conditions are set up, the 
vyrong/missing part recognition host 22 sends out a recognition start signal to the image 
recognition device 10 (step ST5~4 r step ST5~ 5, and step ST5-6). It is detected by a limit switch 
etc, that the work reached the specified position, 

[G0S2]if a recognition start signal is received, according to the image recognition algorithm 
mentioned above, the image recognition device 10 will perform Image Processing Division; and 
will recognize a work (step $15-7). It being characteristic in this example is being able to choose 
from a menu Image Processing Division, such as each "binarvHzing" etc. which the image 
recognition algorithm used for recognition of this work includes, 

[00S3jThe image recognition device 10 returns the wrong/ missing" part recognition host 22 the 
decision result, after finishing recognition and collation processing (step ST5-8X If a collated 
result is a right thing, the wrong/missing part recognition host 22 returns a jig to an original 
position, and sends out said collated result to the good wrong/missing part recognition host 22. 
On the other hand, if the above-mentioned collated result apologizes, clamping a work with a jig. 
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the revolving Nght of the factory Sine and a buzzer will be operated, and it will report to a worker. 
A worker cheeks the actual thing, doe s predetermined repair, and u nci a mps a work. And the 
result is automatically sent out from the wrong/missi hg part recognition host 22 (step 3T5~9>. 
[0DS4]As stated above, the wrong/missing part recognition system in this example became able 
[ an operator ] to build an image recognition algorithm using the menu displayed on the monitor 
32 connected to the image recognition device 10. 

LOGSSlConventionaMy, although the expert had to perform ail coding compile from the -beginning, 
the image recognition algorithm corresponding to a new work. According to this example, when 
those who do not have a know how also choose various kinds of Image Processing Division on 
the monitor 32 r it can register with an algorithm easily. 

[0086]Therefore { the effect that the wrong/missing part recognition system which can respond 

promptly can be provided also to a new work Is acquired. 

[0087] 

[Effect of the Invention] Ao*sordir*g; to this ■■■inventioru it becomes possible to build an image 
recognition algorithm by selection from a menu. Therefore f even if it is not those who became 
sKIPfu! in creation of the program, an image recognition algorithm can be built easily. Of course, 
even if It is an expert it cannot be overemphasized as compared with creating [ which is an 
object of recognition 3 m image recognition a feorithro for every work that an image recognition 
algorithm can be built more easily. 
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[Brief Description of the Drawings] 

[Onswinc 1 jit is a iineblock diagram of the wmng/missing part recognition system which m 
suitable working example concerning this invention, 

[Drawing 2]It Is a line blook diagram of the software of the image recognition device 10. 
[Drawing 3j It is a partial lineblock diagram of the wrong/m isslng part recognition system 
centering on the image recognition device 10, 

IDrawing 4jlt is a linehiock diagram showing only the composition of a mBans by which an image 
recognition algorithm Is built, within the image recognition device 10> 

LDrawlns Silt is an explanatory view explaining detailed operation of the image recognition device 
TO.. 

[Drawing. 6 jit ss a flow chart explaining operation of the wrong/missing part recognition system 
concerning this example. 
[Description of flotations] 
10 Image recognition device 
12 Camera 

14 Lighting system 
18 Camera switcher 

15 Synchronizmg pulse distribution unit 
20 V^deo" signal switcher 

22 Wr®n missing: part recognition host 
24 ALC 

28 Automatic diaphragm Interface Division 
30 Il^mination control Interface Division 

32 Monitor 

33 Menu device 

39 Image Processing Division library 

40 mmZQ driver 
44 Data module 

48 Operati on management task 

50 Initialization task 

54 01/ DO transmission task 

56 DI/BD receiving task 

58 Image taking task 

80 Image Processing Division task 

82 Judgment task 

86 RS232C transmission task 

SO So hedule management memory 

82 Algorithm management memory 

84 Image processing memory 

86 Image Processing Division code table 

88 Measurement Division characteristic quantity management memory 
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90 Characteristic quantity coda table 
92 MBMsur^m&nt Dlvi sjon data memory 
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